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Under non-exponential discounting, we develop a dynamic theory for stopping prob¬ 
lems in continuous time. Our framework particularly covers discount functions that induce 
decreasing impatience. Due to the inherent time inconsistency, the stopping problem is 
presented as an inter-temporal game among a continuum of non-cooperative players. We 
look for equilibrium stopping policies, which are formulated as fixed points of an operator. 

Under appropriate conditions, we show that fixed-point iterations converge to equilibrium 
stopping policies. This in particular provides an explicit connection between optimal stop¬ 
ping times in classical stopping literature and equilibrium stopping policies under current 
game-theoretic setting. This connection is new in the literature of time-inconsistent prob¬ 
lems, and it corresponds to increasing levels of strategic reasoning. Our theory is illustrated 
in a real option pricing model. 
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1 Introduction 

In this article, we build a general theory for stopping problems under time-inconsistent (or 
dynamically-inconsistent) preferences. Time inconsistency of stopping decisions is known to 
exist in casino gambling and financial planning. A general treatment, however, has not been 
proposed so far; see the conclusion of Ebert et al. (2015). Here, we focus on the stopping of a 
diffusion process under infinite horizon, in order to maximize one’s expected discounted payoff. 
Time inconsistency comes from the consideration of non-exponential discount functions. 

1.1 Literature 

The study of time inconsistency goes back to the seminal work of Stroz (1955), where the 
author identifies three different kinds of individuals—the naive, the precommitted, and the 
sophistieated —in the face of time inconsistency. A naive agent constantly changes her choice of 
strategies, in response to her constantly-changing preferences, without realizing the problem of 
time inconsistency. A precommitted agent simply forces herself to stick with the original optimal 
strategy, with no justifiable reason. By contrast, a sophisticated agent works on eonsistent 
planning: she takes into account the possible change of preferences in the first place, and aims 
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to find a strategy that once enforced over time, none of her future selves would want to deviate 
from it. While a sophisticated strategy can be defined through backward iteration in finite 
discrete time (Hayashi (2009)), it has been unclear in the literature how to formulate this 
notion precisely in either infinite discrete time or continuous time. 

A recent literature, particularly in Mathematical Finance, has emerged in response to this 
issue. This includes portfolio choice under non-exponential discounting in Ekeland and Lazrak 
(2006), Ekeland and Pirvu (2008), and Ekeland, Mbodji, and Pirvu (2012), mean-variance port¬ 
folio optimization in Bjork, Murgoci, and Zhou (2014) and the related stochastic linear-quadratic 
control in Hu, Jin, and Zhou (2012, 2015), utility indifference pricing with risk aversion varying 
over different regimes in Pirvu and Zhang (2013), and investment-consumption problem with 
state-dependent risk aversion in Dong and Sircar (2014). In all these different time-inconsistent 
control problems, sub-game perfect Nash equilibrium emerges as the proper formulation for so¬ 
phisticated strategies. In a nutshell, a sophisticated agent continuously plays an inter-temporal 
game among herself today and all her future selves. Built upon this equilibrium idea, a fairly gen¬ 
eral theory of Markovian time-inconsistent stochastic control takes shape in Bjork and Murgoci 
(2014b, a). Research along this line can also be found in Yong (2012). 

There is, however, no equivalent development for stopping problems. Under non-exponential 
discounting, Grenadier and Wang (2007) study optimal investment time in a real options model. 
Since an agent is only allowed to update her time preferences at discrete moments, their analysis 
relies on standard backward iteration and does not shed much light on the general continuous¬ 
time formulation. Barberis (2012) investigates optimal exit strategies in casino gambling. He 
underlines the inherent time inconsistency, and analyses in detail the naive and pre-committed 
strategies, whereas the sophisticated one is not mentioned. Xu and Zhou (2013) character¬ 
ize optimal stopping times under probability distortion. They remark on the involved time 
inconsistency, but do not attempt to resolve it. 

1.2 Contributions 

Our main contribution is the precise formulation of sophisticated strategies for stopping prob¬ 
lems. We introduce an operator 0 in (3.5), which describes the behavior of a sophisticated 
agent. Specifically, for any given stopping policy r, the sophisticated agent improves r through 
one level of strategic reasoning, i.e. anticipating the behavior of her future selves. Sophisticated 
stopping policies are then defined as fixed points of 0, which naturally connects to the concept 
of sub-game perfect Nash equilibrium; see Definition 3.2 and the discussion underneath. 

When the objective function is taken as an expected discounted payoff, we perform fixed- 
point iterations to search for sophisticated (equilibrium) stopping policies. That is, for any 
stopping policy r, we apply the operator 0 onto r repetitively, and expect convergence to 
some fixed point of 0. Here, two crucial conditions are needed. First, we assume that the 
discount function 6 : M+ i—[0,1] is log sub-additive, i.e., 6{s)6{t) < 6{s + t) for all s,t > 
0. This condition in particular captures decreasing impatience, an acknowledged feature of 
empirical discounting in Behavioral Economics; see e.g. Thaler (1981), Loewenstein and Thaler 
(1989), and Loewenstein and Prelec (1992). Hyperbolic and quasi-hyperbolic discounting are 
special cases under our framework; see Assumption 3.1 and the discussion below it for details. 
The second condition. Assumption 3.2, is imposed on the initial stopping policy r the fixed- 
point iteration starts with. These two conditions together imply monotonicity of the iteration 
{0"'r}ngisj (Proposition 3.3). The iteration, as a result, converges, and we show that the limiting 
stopping policy is indeed an equilibrium in Theorem 3.1, which is the main result of our paper. 

An interesting observation is that the stopping strategy of a naive agent, denoted by r, 
satisfies Assumption 3.2. Our main result then implies tq •= hm^^oo 0 ”'t is an equilibrium 
stopping policy. This relation states an explicit connection between the (irrational) naive be¬ 
havior and the (fully rational) sophisticated one, through increasing levels of strategic reasoning 
of the agent. Such a link is new in the literature; see the discussion below Corollary 3.1 for 
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details. Notably, examples show that equilibrium may be found after only finite applications of 
0 on the naive strategy. 

As an illustration of our theory, we introduce in Section 4 a simple model of irreversible in¬ 
vestment planning under a real options framework, where the value process is a one-dimensional 
Bessel process and the discount function is hyperbolic. We derive an explicit formula for the 
naive stopping policy, and provide characterizations for equilibrium policies and all intermediary 
policies obtained through repetitive application of 0. 

The paper is organized as follows. In Section 2, we introduce the setup of our model, and 
demonstrate time inconsistency in stopping problems through examples. In Section 3, we first 
examine a sophisticated agent’s behavior from a game-theoretic perspective. Based on our 
observations, we precisely formulate the concept of (sub-game perfect Nash) equilibrium for 
stopping problems in continuous time. Next, we propose to find these equilibriums via fixed- 
point iterations, and establish the required convergence result. Section 4 thoroughly studies the 
real option model under hyperbolic discounting as an illustration of our theory. Most of the 
proofs are delegated to the appendices. 

2 Preliminaries and Motivation 

2.1 The Model 

Consider the canonical space 12 ;= {w G (^([O, oo); M'’*) : coq = 0}. Let {Wt}t>o be the coordinate 
mapping process Wt(uj) = ojt, and = {T']^}s>o be the natural filtration generated by W, i.e. 

= a{Wu : 0 < u < s). Let P be the Wiener measure on (0,^'^), where := Us> 0 '^i^- 
For each t > 0, we introduce the filtration with 

(2.1) = a{Wuvt -Wt:0<u<s), 

and let F* = {P^}s>o be the P-augmentation of F*’^. We denote by % the collection of all 
F^stopping times r with t > t a.s. For the case where t = 0, we simply write F*^ = {T'°}s>o as 
¥s = and To as T. 

Remark 2.1. In view of (2.1), for any 0 < s < t, Jf is the a-algebra generated by only the 
W-negligible sets. Moreover, for any s,t >0, -measurable random variables are independent 
of Ft; see Bouehard and Touzi (2011), particularly Remark 2.1 therein, for a similar set-up. 

Now, fix t > 0 and iv £ II. We define the concatenation of to and cD G 12 at time t by 

{u;0tdj)s := a;M[o,t)(s) -1 - (w* - uJt)]l[t^oo)is), s > 0. 

By construction, a; (8>t w belongs to 12. Furthermore, for any Tg^-measurable random variable 
^ : 12 1 —)• M, we define the shifted random variable : 12 e-)- M, which is T^-measurable, by 

[?]t,a;(w) := C(w(8)tw), Vw G 12. 

For any r G T, we will simply write lo <Sir(uj) d) as cv <Sit do, and as Note that 

the concatenation of paths in 12 and shifted random variables were introduced in Nutz (2013). 
Bayraktar and Huang (2013, Appendix A) contains a detailed analysis of the properties of 
shifted random variables; in particular, Proposition A.l therein shows that for any r G T and 
T^oo-random variable ^ with E[|^|] < oo, 

(2.2) E[e I Fefiuj) = E [[e]e,a;] for P-a.e. a; G 12. 

Consider the space X := [0, oo) x equipped with the Borel cr-algebra H(X). Let 6 : X M 
and IT : X I— )• R satisfy Lipschitz and linear growth conditions: there is AT > 0 such that for any 
t G [0, oo) and x,y £ R'’*, 

|6(t,x) - b{t,y)\ + \a{t,x) - cr(t,y)| < K\x - y\, |6(f,x)| \cr{t,x)\ < K{1 + |x|). 
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Then, for any t £ T and M'^-valued J>-measurable random variable ^ with lE[|^p] < oo, the 
stochastic differential equation 

(2.3) dXt = b{t,Xt)dt + a{t,Xt)dWt for t > t, with Xr = i a.s. 

admits a unique strong solution, which will be denoted by X'^’^. 


2.2 Classical Optimal Stopping 

We introduce a payoff function g : W, assumed to be nonnegative and continuous; a 

discount function 6 : M_|_ [0,1], assumed to be continuous, decreasing, and satisfy <5(0) = 1. 

Moreover, we assume that 


(2.4) 


E 


sup 6{s-t)g{Xl’^) 

t<s<oo 


< oo. 


V(t,x) E X, 


where we interpret 6{oo — t)g{Xl^) := lims^oo<f(s ~ this is in line with the setup 

in Karatzas and Shreve (1998, Appendix D). Classical literature of optimal stopping (see e.g. 
Karatzas and Shreve (1998, Appendix D), Peskir and Shiryaev (2006, Chapter 1.2), and the 
abundant references therein) is concerned with the problem: given initial time and state {t, x) E 
X, can one find a r E 7* such that her expected discounted payoff 

(2.5) J(f,x;r) :=E[5(r-f)ff(Ah")] 
can be maximized? The associated value function 

(2.6) u(f, x) := sup J(f, x; r) 

has been widely studied, and the existence of an optimal stopping time is affirmative. The follow¬ 
ing is a standard result taken from Karatzas and Shreve (1998, Appendix D) and Peskir and Shiryaev 
(2006, Chapter 1.2). 

Proposition 2.1. For any {t,x) E X, let {Zl’^}s>t be a right-continuous process such that 

(2.7) = ess sup E[5(r - t)g{Xl'^) \ Fs] a.s. Vs > t, 

t&F, t>s 

and define T{t, x) £% by 

(2.8) r(f,x) := inf {s > f : 6{s - t)g{Xl’^) = Zl’^} . 

Then, T{t,x) is an optimal stopping time of (2.6), i.e. 

(2.9) J{t, x; r(t, x)) = sup J{t, x; r). 


Moreover, T{t, x) is the smallest, if not unique, optimal stopping time. 
Throughout this paper, we will constantly use the notation 

Eh-[5(r - t)g{X,)] = E[5(r - t)g{Xtn], V(f,x) E X and r E 7^. 
By (2.2), we observe that for any 0 < t < s and r E 7t with r > s, 

E[i(T - ()9(xy) I 7-,|(,.) = E [[«(T - «)9(xy)], J = 

Since £ Ts, we conclude that (2.7) can be rewritten as 

(2.10) Zl’^ = esssupK^’^”’ — t)g{X.^)] a.s. 

tGTb 


4 






2.3 Time Inconsistency 

The classical optimal stopping problem (2.6) is static, in the sense that it involves only the 
preference of the agent at time t, formulated as the expected discounted payoff in (2.5). Fol¬ 
lowing Stroz (1955), a naive agent simply solves the classical optimal stopping problem (2.6) 
repeatedly at every moment as time passes by. That is, given initial (t, x) G X, the agent aims 
to solve 


(2.11) sup J(s, X*’*; r) at every moment s > f. 

T&Ts 

By Proposition 2.1, the agent at time s intends to employ the stopping time T{s,xt’^) G Ts, 
for all s > f. This naturally raises the question of whether optimal stopping times obtained at 
different moments, r(t, x) and T{t',X^f) with t' > t, are consistent with each other. 

Definition 2.1 (Time Consistency). We say the problem (2.11) is time-consistent if the fol¬ 
lowing holds: for any {t,x) s > t, and a.e. w G Vl, if T{t,x){uj) > s, then 

[r(f, x)]s,(.j(w) = t{s,XI'^{uj)){Cj) for a.e. w G 11. 

We say the problem (2.11) is time-inconsistent if the above does not hold. 

In the classical literature of Mathematical Finance, the discount function usually takes the 
form 5{s) = for some p > 0. This already guarantees time consistency of (2.11). To see 
this, first observe the identity 


(2.12) 5{s)5{t) = 5{s1) Vs,f>0. 

Fix {t,x) G X and pick t' > t such that P[r(f, x) > t'] > 0. For a.e. oj G {r(f, x) > f'}, set 
y := xlf{uj). We observe from (2.8), (2.10), and Xs’^(u! w) = xt ’^(w) that 

(2.13) [Tit,x)]t'^uj = inf > f' : (5(s - f)p(xf’2^) > ess sup’''[(5(r - f)p(X^)]| , 

I tGTs J 

(2.14) T{t',x\f{uj)) = inf is > f' : (5(s — t')g{Xl ’*') > esssupE^’^® '^[<1 (t — t')9i^T)] 

I rSTs 

By (2.12), we obtain 

[T{t,x)]t',co = T{t',Xlf{uj)) = inf |s > f' : p(xf’^) > ess sup E^’^" [5{t - s) 5 ((X^)]| . 

I T&Ts J 

With non-exponential discount functions, the problem (2.11) is time-inconsistent: since the 
identity (2.12) does not necessarily hold, (2.13) and (2.14) do not coincide in general. 

Example 2.1 (Smoking Cessation). Suppose a smoker has a fixed lifetime T > 0. For each 
(f,x) G [0,r] X M+, consider the deterministic cost process Xt’^ = for s G [t,T]. The 

smoker can either (i) quit smoking at some time s <T (with cost Xg) and then die peacefully at 
time T (with no cost), or (ii) never quit smoking during his lifetime (thus incurring no cost) but 
eventually die painfully at time T (with cost Xt). With hyperbolic discount function 6{s) := 
for s > 0, the classical optimal stopping problem (2.6) of minimizing the cost becomes 


xe2 


Hs-t) 


inf (5(s — t)Xl’^ = inf . 

se[t,T] se[t,T] 1 + {s -t) 


By basic Calculus, the optimal stopping time T(t,x) is given by 
(2.15) T{t,x) = 


t 1 
T 


Time inconsistency can be easily observed. Here, 
behavior: the smoker never quits smoking. 
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ift<T-l, 
ift >T-l. 

it particularly illustrates the procrastination 



Example 2.2 (Real Option Model). Suppose {Xt}t>o is a standard Brownian motion. Consider 
the payoff funetion g{x) := |x| for x G M and the hyperbolic discount function 6{s) := for 
s > 0. Given initial {t,x) G X, the classical optimal stopping problem (2.6) becomes 


sup 

r&Tt 


1 + (r - t) 


which can be viewed as a real options valuation for finding the optimal time to initiate or abandon 
an investment project. In Proposition j.l below, we show that T{t,x) in (2.8) has the formula 

(2.16) T{t,x) = inf |s > t : \Xl'^\ > -^1 + (s — t)| . 

The free boundary s i—>■ -s/l + {s — t) is unusual in its dependence on initial time t. As time 
passes by (i.e. t increases), the free boundary keeps changing, as shown in Figure 1. We clearly 
observe time inconsistency: 'ff{t,x)]t'^i,j T{t',Xjff{u})), for any t' > t, as they correspond to 

different free boundaries. 



Figure 1: The free boundary s ff'l + (s — t) with different initial times t. 

As proposed in Stroz (1955), to deal with time inconsistency, we need to employ a strategy 
that is either pre-committed or sophisticated. A pre-committed agent picks the optimal stopping 
time r(t, x) in (2.8) at initial time t, and forces her future selves to follow r(t, x) through some 
commitment mechanism (e.g. a contract). On the other hand, a sophisticated agent anticipates 
in the first place future preference updating, and aims to find a stopping strategy that once 
being enforced, none of her future selves would want to deviate from it. To precisely formulate 
sophisticated stopping strategies has been a challenge in continuous time. The following section 
focuses on resolving this. 

3 Equilibrium Stopping Policies 

3.1 Objective of a Sophisticated Agent 

Since one may re-evaluate and change her choice of stopping times over time, an agent’s stopping 
strategy is not a single stopping time, but a stopping policy defined below. 

Definition 3.1. A function r : X i—)■ T is called a stopping policy ifT{t, x) GTt for all ft, x) G X, 
and 

(3.1) ker(T) := {(t,x,w) G X x O : r(t,x)(a;) = t} G R(X) x Too- 
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We call ker(T) the kernel of t, and denote by T(X) the set of all stopping policies. 

The idea behind is as follows: given initial {t,x) E X, an agent with a policy r E T(X) will 
modify her choice of stopping times at each moment s >t according to r. At s > t, she employs 
the stopping time t{s, Xs{u))) E Ts- If r(s,As(a;)) = s, she stops right away; otherwise she 
continues. It follows that the moment eventually she will stop, when employing r E T(X), is 


(3.2) 


£r(t, x)(w) := inf {s > t : r(s, A*’^(a;))(a;) = s} 

= inf {s > t : {s, Xl’^(io), io) E ker(r)} 


With (3.1), the map {t,x,uj) i-)- CT{t,x){uj) from (X x x Fco) to (M+,.S(M+)) is mea¬ 

surable. This particularly ensures that Tr(t, x) is a well-defined stopping time. 

Lemma 3.1. CT{t,x) E % for all {t,x) E X. 

Proof. For any s > t, E := {{t,x,uj) E X x 12 : CT{t,x){uj) < s} E B(1C) x T'oo- It follows that, 
for any fixed {t,x) E X, the (t, x)-section := {w E 11 : CT{t,x){uj) < s} E Note that 

by definition of CT{t, x), {cu E II : CT{t, x){uj) < s} is independent of <t(IF„ : u < £) for all i < t 
and a{Wu : u > r) for all r > s. Thus, {w E H : CT{t,x){ijj) < s} E F^. □ 

Remark 3.1 (Naive Stopping Policy). The function r : X i—)■ T, defined in (2.8), belongs to 
T (X). Indeed, T{t, x) = t if and only if 

(t, x) E A := I (t, x) E X : g{x) = sup E[(I(r — t)g{Xl'^)] 1 E B(X). 

I reTt } 

It follows that ker(T) = A x H E B{X) x Foo. We call r the naive stopping policy, as it is the 
policy followed by a naive agent, as discussed in Section 2.3. 

Example 3.1 (Real Option Model, Continued). Recall the setting of Example 2.2. Considering 
T E T(X) given by (2.16), we note that the actual stopping time in effect is 

CT{t,x) = inf{s > t : r(s, A*’*) = s} = inf{s > t : \X\'^\ > 1}, 

which is different from the original decision T{t,x) in (2.16). 

We can now lay the ground for equilibrium policies. Suppose that an agent is given a 
stopping policy r E T(X). At each {t,x) E X, we assume that the agent considers the problem: 
“assuming that all my future selves will follow the policy r, how can I improve my stopping 
time r(t, x) today at time t?” Notice that the agent at time t has only two possible actions: 
stopping and continuation. If she stops at time t, she gets g{x) immediately. If she continues 
at time t, since her future selves are assumed to employ T[s,xt’^) E Ts for all s > t, she will 
eventually stop at the moment 


(3.3) 


C*T{t,x){uj) := inf {s > t : r(s, A*’^(a;))(w) = s} 

= inf {s > t : (s, A*’^(a;),w) E ker(T)} , 


and her expected payoff is 

J{t,x]C*T{t,x)) =E*’^ [5{C*T{t,x) - t)g{Xc*r{t,x))\ ■ 

Intuitively, if the agent at time t chooses to continue, she does not care about what r E T(X) 
tells her to do at time t. She starts to follow r only when she goes beyond time t. This is why 
we have “s > t” in (3.3), instead of “s > t” as in (3.2). As in Lemma 3.1, under (3.1), the 
map {t,x,Lo) !-)• C*T{t, x){lj) from (X x Q,B{X) x Foo) to (]R+,R(M+)) is measurable, which 
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guarantees that C*T{t,x) G Tt for all {t,x) G X. As a result, J{t,x;C*T{t,x)) in the above 
equation is well-defined. Some simple properties of £ and C* can be found in Lemma A.l. 
Now, we separate the space X into three distinct regions 

5,-:= {(t,x) G X : g{x) > J{t,x]C*T{t,x))}, 

(3.4) Cr := {(t,x) G X : g{x) < J{t,x-,C*T{t,x))}, 

It := {(t,x) G X : g{x) = J{t,x]C*T{t,x))}. 

For any (t,x) G X, assuming that all future selves will follow r G T(X), we can improve the 
stopping time r(t, x) at time t as follows: 

1. If (t,x) G Sr, the agent stops immediately at time t. 

2. If (f,x) G Cr, the agent continues at time t, and expects to stop at £*r(t, x). 

3. If (t,x) G It, the agent keeps her strategy T(t,x), and expects to stop at CT(t,x). 

To summarize, for any r G T(X) and (f,x) G X, we introduce 


(3.5) 


0r(t, x) 


/ 

t 

< CT{t,x) 
^C*T{t,x) 


for (t, x) G Sr 
for (t, x) G Ir 
for (t, x) G Cr 


Lemma 3.2. For any r G T(X), the regions Sr, Cr, and C belong to .S(X), and the map 
{t,x,u}) I—0r(t, x)(t<;) from (X x n,i3(X) x Too) to (M+, .8(M_|_)) is measurable. In partieular, 
0r Gr(X). 

Proof. Prom Lemma 3.1 and the discussion under (3.3), we know (i) {t,x,Lo) £r(t,x)(a;) is 
measurable; (ii) {t,x,u) i—>• £*r(t,x)(a;) is measurable; (hi) CT{t,x) G Tt and C*{t,x) G T for all 
(t,x) G X. By Fubini’s theorem and (ii), the map (t, x) i—>■ J{t,x;C*T{t,x)) = E[h(£*r(t,x) — 
t)g(A^f^^^ ^^)] is measurable. It follows that Sr, T, and Cr all belong to .S(X). Now, we 
observe from (3.5) that (i), (ii), and the Borel measurability of Sr, T, and Cr imply that 
{t,x,uj) 0r(t,x)(a;) is measurable. This in particular yields ker(0r) = {{t,x,uj) G X x : 
QT{t,x){uj) = t} £ B{X) X Too- Since (hi) immediately gives 0r(t,x) G % for all (f, x) G X, we 
conclude that 0r G T(X). □ 


By Lemma 3.2, 0 : T(X) i—)■ T(X) generates a new policy 0r G T(X) from any initial r G 
T(X). Notice that we obtain 0r from a one-level strategic reasoning, i.e. the local improvements 
of r at all (t, x) G X. The following definition thus follows naturally. 


Definition 3.2 (Equilibrium Stopping Policies). We say r G T(X) is an equilibrium stopping 
policy f/0r(t,x) = T(t,x) a.s. for all (t, x) G X. We denote by T(X) the collection of all 
equilibrium stopping policies. 


The term “equilibrium” is used in Definition 3.2 as a connection to subgame perfect Nash 
equilibria that are also invoked in the stochastic control literature under time inconsistency; see 
Ekeland and Lazrak (2006), Ekeland and Pirvu (2008), Ekeland et al. (2012), and Bjork and Murgoci 
(2014b), among others. In the present case, the inter-temporal game is described among players 
characterized by each (f, x) G X. The sub-game Markov property is inherent in Definition 3.1, 
in echo to the setup of F = {Tt}t>t in Section 2.1. The Nash equilibrium property relates to 
the fixed point property in Definition 3.2. Nevertheless, those relations are purely formal, and 
we simply stick to our definitions. The Nash equilibrium property brings the next remark. 





Remark 3.2. When {t,x) G Ir, the agent is indifferent between stopping right away and the 
status quo T{t, x). The former choice could be justified if one affirms that “the sooner she stops 
the better”. The later is justified by the absence of incentive to deviate from the assigned r(t, x), 
which is at the root of what defines a Nash equilibrium. From a technical point of view, the later 
choice is also less restrictive for obtaining fixed points of 0. 


A contrast with the stochastic control literature needs to be pointed out. 

Remark 3.3 (Comparison to Stochastic Control). The way we formulate equilibrium in Def¬ 
inition 3.2 differs from previous research on time inconsistency. In stochastic control, local 
perturbation of strategies on small time intervals [t, t + e] is a standard technique. As e —)• 0, 
it provides a characterization of the equilibrium solution, or IPDEs; see Ekeland et al. (2013). 
In our case, local perturbation is carried out instantaneously at time t. This is because an 
instantaneously-modified stopping strategy may already change the expected discounted payoff 
significantly (whereas a control perturbed only at time t generally yields no effect). 

After providing Definition 3.2, we must ask ourselves about the existence of an equilibrium 
stopping policies. Finding at least one element in turns out to be easy. 

Remark 3.4 (Trivial Equilibrium). Define r G T{X) by T{t,x) := t for all {t,x) G X. Then, it 
can be checked that CT{t,x) = C*T(t,x) = t for all {t,x) G X. In view of (3.5), we conclude that 
0T(t, x) = t = T{t, x) for all (t, x) G X, which shows r G f(X). We call it the trivial equilibrium 
stopping policy. 


Example 3.2 (Smoking Cessation, Continued). Recall the setting in Example 2.1. Observe 
from (2.15) that CT{t,x) = C*T{t,x) = T. Then, 


6{C*T{t,x) — t)X^ff: 


\rt,X 
./V rp 


xe2 


i(T-t) 


c*T{t,x) 1 + T-t l + T-t 


Since e^^ = 1 + s at s = 0, s*, with s* ps 2.51286, and e^^ > 1 + s iff s > s*, the above equation 
implies = {(C^;) : t < T — s*}, = {{t,x) : t ^ {T — s*,T)}, and 1^ = {{t,x) : t = 

T — s* or T}. We therefore get 


0r(t, x) 


t for t <T — s*, 

T fort>T-s\ 


To conclude, in this model, whereas a naive smoker will procrastinate the quitting decision, a 
first degree of rationality (i.e. applying Q to t once) recognizes this procrastination behavior 
and pushes the smoker to quit immediately, unless he is already very close to death time T (i.e. 
t>T — s*). It can be checked that this decision 0r is an equilibrium, i.e. 0^T(t,x) = QT{t,x) 
for all {t, x). 

It is worth noting that under the classical case of exponential discounting, characterized by 
the identity (2.12), the connection between the naive and sophisticated agents becomes trivial: 
the naive stopping policy r G T(X) is already an equilibrium. 

Proposition 3.1. Under (2.12), r G T(X), defined in (2.8), belongs to £(K). 

Proof. The proof is delegated to Appendix A.l. □ 
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3.2 The Main Result 


In this section, we look for equilibrium policies through fixed-point iterations. For any r E T(X), 
we apply 0 on r repetitively until we reach an equilibrium policy. In short, we define tq by 

(3.6) ro(t,x):= lim Q^T{t,x) V(t, x)eX, 

n^oo 

and take it as a candidate equilibrium policy. To make this argument precise, we need to show 
(i) the limit in (3.6) converges, so that tq is well-defined; (ii) tq is indeed an equilibrium policy, 
i.e. Qtq = Tq. To ensure that the limit in (3.6) converges, we impose two conditions. 

Assumption 3.1. The function 5 satisfies 5{s)5{t) < d(s + t) for all s,t >0. 

Let us first elucidate the relation between Assumption 3.1 and decreasing impatience. In Be¬ 
havioral Economics and Finance, it is well-documented from empirical evidence that people 
admits decreasing impatience (DI). See e.g. Thaler (1981), Loewenstein and Thaler (1989), 
and Loewenstein and Prelec (1992). When choosing between two rewards, people are more 
willing to wait for the larger reward (more patient) when these two rewards are further away 
in time. For instance, in the two scenarios (i) getting $100 today or $110 tomorrow, and (ii) 
getting $100 in 100 days or $110 in 101 days, people tend to choose $100 in (i), but $110 in (ii). 
Following Prelec (2004, Definition 1) and Noor (2009a, b), we define DI under current context 
as follows: the discount function 6 induces DI if 

(3.7) for any s > 0, 1 ^ strictly increasing. 

Observe that (3.7) readily implies Assumption 3.1, since 6{t + s)/6{t) > 6{s)/6{0) = 6{s) for all 
s,t>0. That is, Assumption 3.1 is automatically true under DI. Note that Assumption 3.1 is 
more general than DI, as it obviously includes the case of exponential discounting. As a result, 
all that is stated here in this section holds for the usual exponential case. 

Assumption 3.2. Let r E T(X) satisfy 

(3.8) C*&T{t,x) < C*T{t,x) a.s. V(t,x) E X. 

It is noticeable that the naive stopping policy r satisfies the above technical assumption. 
Proposition 3.2. r E T(X) defined in (2.8) satisfies Assumption 3.2. 

Proof. The proof is delegated to Appendix A.2. □ 

Assumptions 3.1 and 3.2 together imply the monotonicity of the iteration {0"'r}neN- 
Proposition 3.3. Let Assumption 3.1 hold. If t & satisfies Assumption 3.2, then 

(3.9) Q'^^^T{t,x){(jj) < Q'^T{t,x){oj) V(t,x,u;) E X X D and n E N. 

Hence, tq in (3.6) is a well-defined element in T(X). 

Proof. The proof is delegated to Appendix A.3. □ 

The next theorem is the main result of our paper. It shows that the iteration {0"'r}neN 
indeed converges to an equilibrium policy. 

Theorem 3.1. Let Assumption 3.1 hold. If t ^ satisfies Assumption 3.2, then tq defined 
in (3.6) belongs to T(X). 

Proof. The proof is delegated to Section A.4. □ 
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The following result of the naive stopping policy r, defined in (2.8), is a direct consequence 
of Proposition 3.2 and Theorem 3.1. 

Corollary 3.1. Let Assumption 3.1 hold. The stopping policy tq G T(X) defined by 
(3.10) To{t,x) := lim Q'^T{t,x) V(t,x)GX 

n^cxD 

belongs to T(X). 

As stated in Introduction, Corollary 3.1 is a significant result for the literature of time in¬ 
consistency. First, it states an explicit relation between the (irrational) naive behavior and the 
(perfectly rational) sophisticated one. Moreover, the “improving” procedure in (3.10) corre¬ 
sponds to the increasing levels of strategic thinking of an agent, in anticipation of her future 
behavior. A naive agent follows classical optimal stopping times without any regard to her 
future behavior, whereas a sophisticated one, foreseeing all the pattern of her future behav¬ 
ior, seeks a Nash equilibrium. Between them, there are many degrees of rationality presented 
here: for each n G N, 0"'r can be viewed as a stopping behavior under bounded (or limited) 
rationality, a notion introduced in Simon (1982). 


4 A Detailed Case Study: Stopping of BES(l) 


In this section, we recall the setup of Example 2.2, in the context of real irreversible investment 
(entry or exit) with hyperbolic time preferences: 

(4.1) (5(s) := Vs > 0, 

where /3 > 0 is a fixed parameter. The price process {Xt}t>o is a one-dimensional Brownian 
motion and g{x) := \x\ is the payoff function. Equivalently, can be used model the 

price process, which is a one-dimensional Bessel process. Here, we aim to characterize the naive 
policy, the set of equilibrium policies, and possibly all intermediary policies obtained through 
repetitive application of 0. We comment on the behavioral implications. 

Given initial time and state {t, x) G X := M+ x R, the classical optimal stopping problem 
(2.6) becomes 


(4.2) 


v{t, x) = sup 

T&Tt 


\X... 


l + (5{T-t)_ 


An unusual feature of (4.2) is that the discounted process {5(s — t)v{s, Xt’^)}s>t may not be 
a supermartingale. This makes solving (4.2) for the optimal stopping time T{t,x), defined in 

(2.8) , a nontrivial task. As demonstrated in Appendix B.l, we need to introduce auxiliary value 
functions, and employ the method of time-change as in Pederson and Perkir (2000). The result 
is the following. 

Proposition 4.1. For any {t,x) G X, the optimal stopping time T{t,x) of (4.2) (defined in 

(2.8) ) admits the explicit formula 

(4.3) T{t,x) = inf |s > t > a/1//3-|-(s — t)|. 

Proof. The proof is delegated to Appendix B.l. □ 
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4.1 Characterization of equilibrium policies 

Given a stopping policy r G T(X), we know from Section 3 that T{t,x) indicates stopping 
or continuation at each (t, x) € X. Under current setting, since X is a time-homogeneous 
process, it is reasonable to restrict ourselves to stopping policies r that are time-invariant, i.e. 
T{t,x) = t{x) for all {t,x) G X. In addition, in view of (4.2), there is no distinction between 
a given path and its opposite We are therefore led to focus on stopping 

policies T G T(X) of the form 

(4.4) r(t, x) = inf {s > t : |X*’*| G L} V(t, x)gX, for some L G ^(M+), 

where i3(M_|_) is the Borel cr-algebra of M+. We denote by T^(X) the collection of all r G T(X) 
of the form (4.4), and consider the collection 

f'(X) := {r G r'(X) : 0r(t, x) = T(t, x) a.s. V(t, x) G X} = r'(X) n £:(X). 

Remark 4.1. When the SDE (2.3) is time-homogeneous, whether ^(X) and £'{X.) actually 
coincide is an interesting question of its own. We leave this for future research. 

Lemma 4.1. For any r G ^^(X), there exists a > 0 such that 

(4.5) r(t, x) = Ta(t, x) := inf {s > t > a} (t, x)gX. 

Proof. The proof is delegated to Appendix B.2 □ 

The next question is for which a > 0 can the policy Ta be an equilibrium. To answer this, 
we need to determine the three sets Sr^, Cr^, and Ir,, in (3.4). First, by (3.2) and (3.3), 

g CTa{t, x) = inf{s > t : \Xl'^\ > a} = Ta{t, x), 

C*Ta{t,x) = inf{s > t : > a}. 

Observe that 


(4.7) C*Ta{t,x)=t if |x| > a. 

Thus, when |x| > a, we have J{t,x] C*Ta{t,x)) = |x|, and it follows that 

(4.8) {(t,x)GX : \x\ > a} (Z Ir^. 

If |x| = a, then F[C*Ta{t, x) > t] > 0 and thus 


ol 


{C*Ta{t,x)>t} 


^ ^ x) - t) 


< a = \x\. 


(4.9) J{t,a;C*Tait,x)) 

This implies 

(4.10) G X : |x| = a} C S'^^. 

If \x\ < a, we need to use the lemma below, whose proof is delegated to Appendix B.3. 
Lemma 4.2. On the space {(x,a) G : a > x}, define the function 

r]{x,a) := 


1 + l3{Ta{t,x) - t) 


(i) For any a > 0, x e-)- r]{x, a) is strictly increasing and strictly convex on [0,a], and satisfies 
0 < r/(0, a) < a and rj{a, a) = a. 
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(a) For any x>0, r]{x,a) —>-0 as a —>■ oo. 

(Hi) There exists a unique a* G (0, sueh that for any a > a*, there is a unique solution 

x*{a) G (0, a*) of rj{x, a) = x. Henee, rj{x,a) > x for x < x*{a) and r}{x,a) < x for 
X > x*(a). On the other hand, a < a* implies that r}{x,a) > x for all x G (0, a). 

The figure below illustrates x ri{a,x) under different scenarios a < a* and a > a*. 




We now separate the case |x| < a into two sub-cases: 

1. If a < a*, then Lemma 4.2 (hi) shows that J{t,a] C*Ta{t,x)) = r]{a,x) > |x|, and thus 

(4.11) {(t,xGX) : |x| < a} C 


2. If a > a*, then by Lemma 4.2 (iii), 

(4.12) J{t,a]C*Ta{t,x)) = r]{a,x) < 


/ 

> 


if X < x*(a). 

= 


if X = x*(a). 

< 


if X G (x*(a), a) 


With (4.6)-(4.11), the definition of 0 in (3.5) implies 

QTa{t,x) = inf{s > t : > a} = Ta{t,x), if a < a*. 

Similarly, with (4.6)-(4.10) and (4.12), the definition of 0 in (3.5) implies 

(4.13) QTa{t,x) = tl{|x|>a;‘(a)} +'ra(La:)l{|x|<a:*(a)} y^ra{t,x), if a > a*. 

This shows that we have characterized the entire collection £'(X). 

Proposition 4.2. £'(K) = {xa G T(X) : a G [0, a*]}, for a* > 0 being the solution to 

poo 

(4.14) a / e“'^-^2/3s tanh(a-\/2/3s)ds = 1. 

Jo 

Proof. The existence of a* and the characterization of £'(X) is presented in the discussion above 
this proposition. To find a*, by the proof of Lemma 4.2 in Appendix B.3, one needs to solve 
r]a{a,a) = 1 for a, which leads to (4.14). □ 

Remark 4.2 (Estimating a*). With (3 = 1, numerieal eomputation of (4.14) gives a* ~ 
0.946475. It follows that for a general (3 > 0, a* ^ 0.946475/-^//3. 
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4.2 Construction of equilibrium policies 

When a > a*, although Ta ^ by Proposition 4.2, we may employ the iteration in The¬ 

orem 3.1 to find a stopping policy in T'(X). In general, the repetitive application of 0 in 
Theorem 3.1 can be very complicated. It has, nonetheless, a simple structure under current 
setting; to reach an equilibrium, we need at most two iterations. To establish this, we need the 
next lemma, whose proof is delegated in Appendix B.4. 

Lemma 4.3. For any 0 < x < a and t>0, Ta{t,x) = fa(t,x) := inf{s > t : > o} a.s. 

Proposition 4.3. Let a > a*. Then 

(4.15) Ta := lim 0”ra = 0^ra = T^*i^a) e ^'(X), 

where x*{a) G (0,a*) is given in Lemma 4-^ (Hi) 

Proof. Note that x*{a) < a* < a. We deduce from (4.13) that 

(4.16) CQTa{t,x) = inf{s > t : \X):^\ > x*(a)}, C*QTa{t,x) = inf{s > t : \X\’^\ > x*(a)}. 

It follows that 


C*Ta{t,x) = inf{s > t : \Xl'^\ > a} > inf{s > t : > ®*(a)} = C*QTa{t,x). 

That is, Ta satisfies (3.8). We then conclude from Theorem 3.1 that G T(X) defined by 


Ta{t,x) := lim 0"ra(t,x) V(t,x)GX 

n^oo 

belongs to T(X). The first iteration is already given in (4.13). From this, we deduce that 
{{t,x) G X : |x| > x*(a)} C and {(t,x) G X : |x| = x*(a)} C S'er^, just as how we derive 
(4.8) and (4.10). To determine Cer^, Lemma 4.3 and Lemma 4.2 imply that, if |x| < x*{a), 

J{t,X-C*QTa{t,x)) = J(t,x;f3..(a)(t,x)) = J {t, X] T^* (^a){t, x)) > |x|. 

Thus, {(t,x) G X : |x| < x*(a)} C C^ra- We then conclude from (4.16) that 

0 XaitiX) 'L Xx* (^a)'^{\x\<x*(a)} FE*(a)(^)®) a.S., 

where the second equality follows again from Lemma 4.3. In view of Proposition 4.2, T^*(^a) is 
already an equilibrium policy in T'(X). □ 

As emphasized under Corollary 3.1, (3.10) connects the naive and sophisticated agents. 
Under current setting, with the naive strategy r G T(X) given explicitly in (4.3), we intend to 
find a formula for tq := lim„^oo 0"'^^ as explicit as possible. Set a := We observe from 

(4.3) and (4.6) that 

Tr(t, x) = inf{s > t : \X(:^\ > a} = rs(t, x) = CTa{t, x), 

C*T{t,x) = inf{s > t : > a} = C*Ta{t,x). 


It follows that QT{t,x) = 0ra(t,x). Note that a > a* from Remark 4.2. We may then apply 
Proposition 4.3 to r^. This gives ro(t,x) = limn^oo&^'ra{t,x) = <cP‘Ta{t,x) = Tx*(a){t,x). By 
the proof of Lemma 4.2 in Appendix B.3, in order to find x*(a), we need to solve the equation 


x) 


2 _ 

—= / cosh(xy2^) sech(\/^)ds = X 

VP io 


for X. Numerical computation shows that x*{a) = x*{l/^/P) « 0.92195/v^- Since x*(l/v^) < 
a *for all /3 > 0, the equilibrium is reached in only one step. 
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Here, we draw a conclusion reminiscent of Grenadier and Wang (2007). Independently of 
the initial time, the payoff obtained at the moment of stopping is greater when using the naive 
policy (the payoff is a) than using the equilibrium policy derived from it (the payoff is x*(a) < a). 
We explain this behavior by the very explicit calculations in Proposition 4.3. When a reward is 
away from present, low impatience predominates in our computations. In a dynamic setting, an 
agent must anticipate her future eagerness to stop when the reward gets closer, and thus lower 
her expected payoff. From Proposition 4.1, we also notice that, at the moment of stopping, both 
of the above strategies provide lower payoffs than the pre-committed strategy, i.e. committing 
to the initial optimal stopping time. 


4.3 Further considerations on selecting equilibrium policies 

Given the characterization of £1'(X) in Proposition 4.2, it is natural to ask which equilibrium 
policy in £'{X) one should employ. Given {t,x) G X, since a sophisticated agent intends to 
apply an equilibrium policy, the stopping problem she faces can be formulated as 


(4.17) 

Under current setting, (4.17) becomes 

IX 


sup J(t,X‘,T(t,x)). 
reS'CX) 


(4.18) 


sup 

ree'(x) 


r{t,x) I 


= sup 




a£[x,a*\/x] _ 1 “t“ p(Fa(^) ^) t) _ 


1 + l3{T{t,x) - t) 
where the second equality follows from Proposition 4.2. 

Proposition 4.4. Tq* G £0Q solves (4.18) for all {t,x) G X. 

Proof. Fix a G [0, o*). For any (t, x) G X with x < a < a*, Ta{t, x) < Ta* {t, x) a.s. We then have 

1 


J{t,x;Ta*it,x)) = E*’^ 
= E^’* 
> E*’^ 


1 + l3{Ta*{t,x) - t)_ 


> E' 


t,X 


1 


_1 + /3{Tait,x) - t) 
a 


^Ta{t,x),a 


1 + /3{Tait,x) -t)l + /3{Ta*{t,x) - t) _ 
a* 


1 + /3{Ta{t,x) - t) 
where the last inequality follows from Lemma 4.2 


1 + (5{Ta*{Ta{t,x),a) - Ta{t,x)) 
= J{t,X-,Tait,x)), 


□ 


The conclusion is twofold. First, it is possible, at least under current setting, to find one 
single equilibrium policy that solves (4.18) for all {t,x) G X. Second, this “optimal” equilibrium 
policy Ta* is different from tq = Tx*(a)^ obtained from the naive strategy r under strategic 
anticipation in (3.10). For a general objective function J{t, x\ r), there is thus a strong incentive 
for obtaining the whole set £'{fK) (or T(X)), instead of only applying Corollary 3.1. 


A Proofs for Section 3 

Throughout this Appendix, we will constantly use the notation 
(A.l) := 0 "t n G N, for any t G T(X). 

Also, we collect some useful properties of £ and C* in the next lemma. We omit the proof as 
the properties are simple consequences of (3.2) and (3.3). 

Lemma A.l. We have 
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a. T{t,x) > t implies CT{t,x) = C*T{t,x); 

b. if T{t, x) = t, then t = £r(t, x) < C*T{t, x); 

c. if C*T{t,x){uj) = t, then there exist {tm}meN in K+, depending on u, such that tm ft and 
T{tm,xl’^{uj)){uj) = tm for all m G N. 

d. if C*T{t,x){uj) = s > t, then (a) t{s, Xl’^{uj)){u}) = s or (b) there exist {tm}meN 'In M+, 
depending on uj, such that t^ f s and T{tm, Xl’^{u})){uj) = tm for all m G N. 


A.l Proof of Proposition 3.1 

Fix (t, x) G X. If T{t, x) = t, by (2.9) we have 


9{x) 


sup - t)g{Xr)] > 

T&Tt 




which implies (f, x) G U We then conclude from (3.5) that 


(A.2) 


0r(t, x) 


t if (t, x) G _ 

£r(t, x) if (t, x) G Ir 


where Crit^ x) = T{t, x) follows from T{t, x) = t. 

Now, assume T{t,x) > t. Under (2.12), with the same argument following it in Section 
3.1, shows that T{t,x){u) = t{s, Xl’^{u)){uj) for all s < CT{t,x){uj), for a.e. u G Q. Thus, 
C*T{t,x) = CT{t,x) = inf{s > t : r(f, x) = s} = T{t,x) a.s. This, together with (2.9), shows 
that 




d{C*T{t,x) -t)g{X^.~(^^^^^] 


= E' 


t.X 


6{T{t, x) - t)g{x~^^^^^) > g{x) 


which implies (t, x) G Ir U C^- We then conclude from (3.5) that 


(A.3) 


0r(t, x) 


Crit^x) if (t, x) G Ir 
£-f(t,x) it(t,x)eCf 


Combining the above two cases, we have QT{t,x) = T{t,x) a.s., as desired. 


A.2 Proof of Proposition 3.2 

Fix (t, x) G X. Set to := C*T{t,x). For a.e. w G 11, there are three possible situations at time 
to{uj). Case (i): to(uj) = t. Case (ii): to{oj) > t and 

(A.4) T{to{u),xl’^{u:)){uj) = to{u). 


Case (iii): to{oj) > t, but (A.4) does not hold. 

In the following, we first analyze Case (ii), and then deal with Cases (i) and (iii) together. 
Case (ii): By (2.8) and the right-continuity of {Zl'^}s>t, (A.4) implies 


(A.5) 
and thus 
(A.6) 




£r(to(w),X*;"'(a;))(a;) = to{u;). 


On the other hand, (A.5) and (2.7) in particular imply 


g{Xlf{uj)) > 


d{C*Iito,xl’;)-to)g{X^ 


r(t0,X^P^ 
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which shows that {tQ{uj), (uj)) ^ C^. We then conclude from (3.5) and (A.6) that 


(A.7) 0?(to(^),<"(u;)) 


to{u) if {to{uj),xl'^{uj)) GSr ^ w N 

C?{toiu:),Xlf{oj)) if{toico),Xl’^{oo))Gl, 


This, together with to{uj) > t, shows that £*0r(t,a:)(a;) < to{uj). 

Cases (i) and (iii): In either case, there must exist {tnjneN in depending on a;, such that 
tn i to{uj) and T{tn, xj’^ (io)) = tn for all n E N. Thanks again to (2.8) and the right-continuity 
of {Zi'^]s>u this implies 


(A.8) 




Vn E N. 


With (A.8), we may argue as in Case (ii), with to replaced by tn, to show that &T{tn, Xl^(oj)) = 
tn for all n E N. This implies £*0r(t, a;)(a;) < tn for all re E N. As re —>■ oo, we get 
C*QT{t,x){uj) < to{io). 


A.3 Derivation of Proposition 3.3 

We need the following technical result. 

Lemma A.2. For any r E T(X) and {t,x) E X, define to := C*Ti{t,x) E 7) and sq := 
C*T{t,x) E Tt, with Ti as in (A.l). If to < sq a.s, then for a.e. cu E {t < to}; 

ff(A*’"(a;)) < E [<i(so - to)g{Xl^^) \ Xt,] (ca). 

Proof. For a.e. w E {t < to} E T), we deduce from to{io) = £*ri(t, x){io) > t that ri(s, xt’^{io)){io) > 
s for all s E {t,to{u})). By (A.l) and (3.5), this in particular implies {s,xI’^{lo)) ^ Sr for all 
s E (t,to(a;)). We therefore have 


(A.9) 


giXl’^ioo)) < (-) [<5(£V(s, AJ - s)g 


6{C*t{s, AJ - [to];,,a;)5 ( e (t, fo(w)) 


where the second line holds because 6 is decreasing and d,g are both nonnegative. 0n the other 
hand, by (2.2), it holds a.s. that 

(A.IO) E[6{so - to)g{Xl’^^) \ A,](w) = E [<5([so].,^ - Ns,a;)ff([A,'f ],,^)] Vs > t, s E Q. 


Note that we have used the countability of Q to obtain the above almost-sure statement. For 
any fixed w E P such that to{uj) < so{co), if s E (t,to{co)), then s < so(w) and thus [so]s,i.j(<^) = 
so{uj (8)s w) = C*T{t,x){uj dj) = C*t{s, xI’^{uj)){lo), for all u G Q. We then conclude from 
(A.9) and (A.IO) that it holds a.s. that 

(A.11) 5(A*’"'(a;)) l{(t,to(i.z))nQ}(■s) < E[(i(so - to)g{Xl'^) \ As](a;) l{(t,to(a;))nQ}(s)- 

Since our sample space P is the canonical space equipped with the (augmented) natural filtration 
E generated by the Brownian motion W, the martingale representation theorem holds under 
current setting. This in particular implies that every martingale has a continuous version. Let 
{Ms}s>t be the continuous version of the martingale {E[(i(so — to)g{Xl'fi) \ As]}s>t. Then, 
(A.ll) immediately implies that it holds a.s. that 

(AT2) g'(A*’^(a;)) l{(t,toH)nQ}(s) < Ms{u}) l{(t,toH)nQ}(s)- 

Also, using the right-continuity of M and (2.2), one can show that for any t G Tt, Mr = 
IE[5(so ~ to)g{Xi'Q) I Tr] a.s. Now, we can take some P* E Too with E[P*] = 1 such that for all 
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bj G 0,*, tQ{u}) < so{uj), (A.12) holds true, and MtQ{u) = E[(5(so — tQ)g{Xlf ) \ FtQ\{oj). For any 
a; G n* n {t < to}) take {A:„} C Q such that kn > t and kn t Then, (A.12) implies 

ff(4’;(a;))<Mfc„(a;) Vn G N. 

As n —)• oo, we obtain from the continuity of s i-t- and z i—>■ g{z), and the left-continuity of 
s ^ Ms that g(xlf(cu}) < Mt,{oj) = E[5(so - to)g{xtf) \ T)J(u;). □ 

The previous lemma leads to useful properties of {0”r} and {£*0”r}. 

Proposition A.l. Let Assumption 3.1 hold. If t G T(X) satisfies Assumption 3.2, then for 
each n G N, 

(i) Q‘^T{t,x){uj) = t Q‘^~^^T{t,x){uj) = t, V(t, X, w) G X X n. 

(a) C*&'^~^^T{t,x){uj) < C*&'^T{t,x){u), V(t,x,a;) G X x ft. 

Proof. It suffices to prove the result for n = 1, as the remaining follows from induction in n. 
Fix {t,x,uj) G X X n, and recall the notation in (A.l). We will first prove (i), i.e. ri(t,x)(a;) = 
t implying T 2 {t,x){Lo) = t. Suppose Ti{t,x){Lo) = t. If C*Ti{t,x){uj) = t, then (3.5) and 
Lemma A.l immediately give T 2 {t,x){uj) = 0ri(t,x)(a;) = t, as desired. We therefore assume 
below that C*Ti{t, x){lj) > t. By (3.5), ri(t,x)(a;) = t implies 

(A.13) g{x) > E[6{£*T{t, x) - 

Let to := T*ri(t, x) and sq := C*T(t,x). Using the above inequality, to < sq a.s. (this is (3.8)), 
Assumption 3.1, and g being nonnegative, we obtain 


g{x) > E[5(so - t)g{X,.’fi)] > E[5(to - t)6{so - to)g{X'^)] 


= E [<5(to - t)E [6{so - to)<7(X 
> E [,5(to - t)g{Xlf 


t,X\ 

So ) 




where the second line follows from the tower property of conditional expectations, and the third 
line is a consequence of Lemma A.2 (note that t < to < sq a.s. under current setting). This 
implies (t, x) ^ , and thus 


(A.14) 


T2{t,x){uj) 


t for (t, x) G Sri 

CTi{t,x){ijj) for (t,x) G In 


where CTi{t,x){uj) = t because ri(t, x)(ti;) = t. This finishes the proof of (i). 

Now, observe that (ii) is a consequence of (i). If £*Ti(t, x)(a;) = t, then there exist a 
sequence {tnjneN in E_|_, depending on w, such that tn i t and rfitn, X\'^{ljj)){oj) = tn for 
all n G N. By (i), we must also have T2(tn, X ^’^for all n G N. This implies 
C*T2{t,x){uj) = t = C*Ti(t,x){co). 0 n the other hand, if to(‘^) := T*Ti(t,x)(a;) > t, then 
there are two possible cases: (1) C*Ti{to{uj), X^’^ {io)){u) > to{uj). Then, the fact that t < 
to{uj) < C*Ti{to{uj), Xj^^{ u})){ijj) implies Ti{to{uj), Xj^^{u})){uj) = to{uj). By (i), we must also have 
T2{to{uj), Xl’^^{u)){uj) = to{uj). This implies C*T2{t, x){uj) < to{uj) = C*Ti{t,x){uj), as desired. 
( 2 ) C*Ti{to{u}), Xl^^ {uj)){uj) = to{u). Then, there exist a sequence {tnjneN in K+, depending on 
CO, such that tn i to{uj) and Ti(tn, X^’^{co)){uj) = tn for all n G N. By (i), we must also have 
T2{tn, Xl’^{uj)){co) = tn for all n G N. This implies C*T2{t, x){co) < to{uj) = C*Ti{t,x){uj), as 
desired. □ 


Now, we are ready to prove Proposition 3.3. 
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Proof of Proposition 3.3. Fix n E N and {t,x,io) E X x 0. For a.e. w E if 0"'+^T(t, x)(u;) = 
t, (3.9) holds trivially. Assume a:)(a;) > t. By (3.5) and Lemma A.l, this im¬ 
plies 0"’'''^r(t, x)(a;) = x){co) > t. In view of Proposition A.l (i), we must have 

0”r(t,x)(a;) > t. We then conclude again from (3.5) and Lemma A.l that 0"'r(Lx)(a;) = 
C*Q^-^r{t,x){u}) > t. Finally, we obtain from Proposition A.l (ii) that 0"+^T(t, x)(w) = 
£,*Q^r{t,x){uj) < C*Q"‘~^T{t,x){uj) = 0"'r(t, x)(t<;). 

Under (3.9), ro(t, x) in (3.6) is a well-dehned limit of a sequence of stopping times in %, and 
thus belongs to %, too. Moreover, since {t,x,uj) i->- Q^T{t,x){uj) is measurable for all n E N (by 
Lemma 3.2), {t,x,u}) ro(t,x)(w) = lim^^oo 0 ”t(L ^)(^) is measurable. This in particular 
implies that ker(ro) = {(t,x,uj) E X x 11 : To{t,x){uj) = t} G i3(X) x Too- We thus conclude that 

TO E r(x). □ 

Remark A.l. In general, (3.9) does not hold for n = 0. The proof above establishes &^~^^T{t,x) < 
Q'^T{t,x) from C*Q'^T{t, x) < C*Q'^~^T(t,x), for all n E N. This argument, however, does not 
hold when n = 0. Thus, “@T(t,x) < T{t,x)” may not be true. 


A.4 Derivation of Theorem 3.1 

Lemma A.3. Suppose Assumption 3.1 holds and r E T(X) satisfies (3.8). Given {t,x,uj) E 
X X n, To defined in (3.6) satisfies 

£*To{t,x){u)) = lim C*Q"'T{t,x){uj). 

n^oo 

Furthermore, on the set {w E H : Q^T{t,x){uj) > t for all n E N}, we have 
TQ{t,x){uj) = C*TQ{t,x){ijj) = lim i2*0”r(t,x)(w). 

n^oo 

Proof. We will write = 0 ”t for all n E N, as in (A.l), and define to := hm^^oo x). 

Case I: C*Ti{t, x){u}) = t for some -1 E N. By Proposition A.l (ii), we have to{u) = t. By (3.3), 
there exist a sequence {tmjmeN in depending on w, such that tm ft and rfitm, Xj^(Lo))(u;) = 
tm for all m E N. By Theorem 3.3, this implies that To{tm, = tm for all m E N. We 

thus conclude that C*To{t, x){uj) = t = to(<^)- 

Case II: C*Tn{t,x){uj) > t for all n E N and to{uj) = t. Let := C*Tn{t, x){u}) > t. For each 
n E N, in view of Lemma A.l, we have either (i) Tn{tn, xl’^{io)){uj) = tn or (ii) there exist a 
sequence {sfcjfceN in M+, depending on lo, such that s^ f tn and Tn{sk, Xl’fi {uj)){lj) = s^ for 
all /c E N. Since tn i to(a;) = t, we can construct from (i) and (ii) a real sequence {I'njneN 
such that £n i t and Tn{in, X^f^= in for all n E N. By Theorem 3.3, this implies 
TQ{in, X^f^{u])){uj) = in for all n E N. We thus conclude that C*TQ{t,x){uj) = t = to(a;). 

Case III: C* Tn{t,x){uj) > t for all n E N and to(a;) > t. By Proposition A.l (ii), we must have 
C*Tn{t,x){io) > to(a;) > t for all n E N. This implies that for all s E (t,to(a;)) and n E N, 

(A.15) C*Tn{s,Xl’^{u!)){uj) = C*Tn{t,x){uj), 

(A.16) Tn{s,Xl’^{u})){uj) > s. 

In view of (3.5) and Lemma A.l, (A.16) implies 

(A.17) Tn+l{s,Xl’-{w)){u) = eTn{s,Xl’^u)){uj) = C* Tn{s, Xl’^w)) (w). 


Thanks to (A.17) and (A.15), we get 

To(s,X‘’^(a;))(a;) = lim Tn{s, Xl’^{ uj)){uj) = lim C*Tn{s,Xl’^{uj)){u) 

n^oo n—^oo 

= lim C*Tn(t,x)(u)) = to(a;) Vs E (t,to(w)). 


(A.18) 
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This in particular shows that 

(A.19) ro(s, A*’^(a;))(a;) > s Vs G {t,to{u)). 

To complete the proof, we deal with two sub-cases. 

Case III-l: C*Tn{t,x){uj) > for all n G N. Then, we observe that (A.15), (A.16), 

and (A.17) remain true with s = tQ{u}). It follows that (A.18) also holds with s = to(w)- 
This, together with (A.19), shows that C*To{t, x){lj) = to{uj). 

Case III-2: C*Ti{t,x){ijj) = for some £ G N. If T£{tQ{Lo), = to{uj), by 

Theorem 3.3 we have To{to{io), {co)){io) = to(cu)- This, together with (A.19), shows 

that C*TQ{t,x){Lo) = to{u}). On the other hand, if T£(to{u}), X^’^^(uj)) > tQ{u}), we see from 
Lemma A.l that there exist {tm}meN fo depending on u, such that tm i io(w) and 
xl’^ (w))(a;) = tm for all m G N. By Theorem 3.3 again, ro(tm, (w))(a;) = tm for 
all m G N. This implies C*To{t,x){uj) < tm for all m G N, and thus C*To{t,x){uj) < tQ{co). 
Since (A.19) already implies C*TQ{t,x){io) > tQ{u), we conclude C*To{t, x){uj) = to{uj). 

Finally, on the set {cj G 0 : Tn{t, x){u}) > t for all n G N}, we observe from (3.5) and Lemma A.l 
that Tn+i{t,x) = C*Tn{t,x) for all n G N. It follows that 

(A.20) ro(t,x) = lim Tn{t,x) = lim C*Tnit,x). 

n^oo n^oo 


□ 


Now, we are ready to prove Theorem 3.1. 

Proof of Theorem 3.1. By Theorem 3.3, tq G T(X) is well-defined. For simplicity, we will write 
Tn = 0"'T for all n G N. Fix {t,x,uj) G X x 12. We first deal with the case where Te{t,x){u}) = t 
for some £ G N. By Proposition A.l (i), Tn{t,x){uj) = t ioi n > £. This implies To{t,x){uj) = t 
and thus £ro(t,x) = t. Observe from (3.5) and r„(t,x)(a;) = t \/n > i that (t,x) ^ Cr„ \/n > £ 
, i.e. 

g{x) > [5{£*Tnit, x) - t)9(^/;.r„(t,x))] Vre > £. 

Sending n —>■ oo, we obtain from Lemma A.3 below that 

g{x) > E*’"^ [(5(£*ro(t,x) - t)g{Xc*ro{t,x))\ , 

which shows that (t, x) ^ Cr^. We then conclude from (3.5) and Tro(f, x) = t that 0To(t, x)(a;) = 
t = ro(t,x)(a;). For the other case where Tn{t,x){uj) > t for all n G N, we have Tn+i{t,x) = 
0T„(t,x) > t for all n G N. This, together with (3.5), implies (t,x) ^ Sr„, i.e. 

g{x) < E*’" [d{C*Tnit, x) - t)5(^/:*r4i,x))] Vn G N. 

Sending n —>■ oo, we obtain from Lemma A.3 that 

g{x) < E*’^ [6{C*To{t,x) - t)g{Xc-.^a(t,x))] , 

which shows that (t,x) ^ Srg- In view of (3.5), Lemma A.l, and Lemma A.3, we have 
0To(t,x)(a;) = C*TQ{t,x){uj) = To(f,x)(a;). We therefore conclude that tq G T(X). □ 
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B Proofs for Section 4 


B.l Derivation of Proposition 4.1 

An unusual feature of (4.2) is that the discounted process {(i(s — t)v{s, Xl’^)}s>t may not be 
a supermartingale. To see this, observe that in the classical case of exponential discounting, 
(2.12) ensures 

(5(s — t)u(s, X^’*) = sup [(5(s — t)(i(r — s)g(X.,-)] = sup [6{t — t)g{X^)] s>t, 

T&Ts T&Ts 

which shows that {5(s — t)v{s, Xl’^)}s>t is a supermartingale. Under hyperbolic discounting 
(4.1), since 5(ri)5(r2) < 5{ri + r 2 ) for all ri,r 2 > 0, {5(s — f)u(s,Xs’^)}s>t no longer coincides 
with the supermatingale {sup.,-g-j^ E*’^® [(5(r — t) 5 ((X.,_)]}s>t. Standard approaches for optimal 
stopping problems, therefore, can not be applied to (4.2). 

To overcome this, we introduce an auxiliary value function. For any fixed t > 0, define 


V{t, s, x) := sup E*’"" [6{t - t)g{X^)] 

r&Ta 


(B.l) 


= sup E"’"^ 

tGTs 


\X^ 


1 + /3(t - t) 


for {s,x) E [t, oo) X M. 


By definition, V{t,t,x) = v{t,x), and the process {V{t, s, Xl’^)}s>t is a supermartingale. The 
associated variational inequality for V{t, ■, •) is the following: for (s,x) E [t, oo) x M, 


(B.2) 


1 |x| 

min { Wsit, s, x) + s, x), w{t, s, x) - 


= 0 . 


We are able to solve this equation explicitly. 

Proof of Proposition 4-P The equation (B.2) can be rewritten as a free boundary problem 


(B.3) 


U 5 (t,s,x) + iua;a;(t, s,x) = 0, v{t,s,x) > , for |x| < 5(t, s); 

v(t, s, x) = for |x| > h{t, s). 


where s i—?■ b{t, s) is the free boundary to be determined. Following Pederson and Perkir (2000), 
we propose the ansatz 


w{t, s, x) = 


-.h 


i/l + /3(s — t) y \/l + (3{s — t) j 
Equation (B.3) then becomes a one-dimensional free boundary problem: 


(B.4) 


-(5yh'{y) + h''{y) = /3h{y), h{y) > |y|, for \y\ < 


h{y) = |y|> 


for \y\ > 


6(t,s) 




Since (t, s) does not appear in the above ODE, we take 6(t, s) = a^\ + /3(s — t) for some a > 0. 
The general solution of the first line of (B.4) is 


£- 1,2 


h{y) = €2^ I Cl + C2\l ^ 


'■Vmy 


e “ du , (ci,C 2 ) E 
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The second line of (B.4) gives h{a) = a. We then have 


w{t, s, x) 


/3x^ 

g2(l+,g(s-t)) 

< \/l+/3(s—t) 


l+0(s-t) ’ 


^Ci + C2 



\/l+/3(s—£) 


0 



x| < Oa/I + /3(s — t); 
x\ > oa/I + /3{s — t). 


To find the parameters ci,C 2 and a, we equate the partial derivatives of (s,x) w{t,s,x) 
obtained on both sides of the free boundary. This yields the equations 


a = 


S-o? 

62 



and sgn(x) — C 2 = sgn(x)a^/3. 


The last equation implies C 2 = 0. This, together with the first equation, shows that o. = 1lyf]3 
and Cl = . Thus, we obtain 

(B.5) = +(*-») . 

|^w(t,s,x) = for |x| > a/1//3 + {t- s). 

Notice that w{t, •, •) is on [t, +oo) x M, and on the domain 

|(s,x) E [t,oo) X M : |x| < a/1//3 + (t — s)| . 


Moreover, from (B.5), Ws{t,s,x) + ^Wxx{t, s,x) < 0 for |x| > y^l//3 + (s — t). We therefore 
conclude from the standard verification theorem (see e.g. 0ksendal and Sulem (2007, Theorem 
3.2)) that V{t, s, x) = w{t, s, x) is a smooth solution of (B.3). This implies that {V{t, s, Xi’^)}s>t 
is a supermartingale, and {V (t, s A r*(t, x), ^ martingale, with r*(f, x) := 

inf{s > f : |x| > a/1//? + (f — s)}. It then follows from standard arguments that T*{t,x) is the 
smallest optimal stopping time of (4.2). In view of Proposition 2.1, we must have r(f,x) = 
T*{t,x). □ 


B.2 Proof of Lemma 4.1 

Given r E S'{X) = T'(X) n T(X), we have 

(B.6) 0(t,x) = T{t,x) = inf{s > t : \Xl'^\ E L} for all (f, x) E X, 

for some Borel subset L of M+. Set a := inf L. We claim that T{t,x) = Ta{t,x) = inf{s > t : 

> a} for all {t, x) E X. If L = [a, oo), there is nothing to prove. Assume that there exists 
X > a such that x ^ L. Define 

(B.7) I := sup {a E L ; a < x} and u := inf {6 E L : 6 > x} . 

Case I: X = a. As a = infL, there exist {an},igN in L such that a. Thus, by the same 
calculation as in (4.9), we have |x| > J(f,x;£*r(t,x)). By (3.5), this implies 0r(t,x)(a;) = t, 
and thus T{t,x){uj) = t, for all w E D. In view of (B.6) and X being a Brownian motion, we 
must have x E L, a contradiction. 

Case II: X > a and i < u. Take y E {i,u). Then T{t,y) > t, and thus QT{t,y) > t. By (3.5) 
and Lemma A.l, this implies QT{t,y) = C*T{t,y). We therefore have T{t,y) = C*T{t,y). Now, 

Jit, y-Crit, y)) = Jit, y, r(t, y)) < |] = in\Xrit,y) I = ^] + \ = u] = x, 

where the last equality follows from | = P\ = and = u] = obtained 

from the optional sampling theorem. By (3.5), this implies 0r(t,y) = t, a contradiction. 

Case II: X > a and i = u = x. Since x > a, we trivially have Tait, x) = t. 0n the other hand, 
£ = u = X implies £*T(f,x) = t. By (3.5), we have 0r(f,x) = t, and thus r(t,x) = t. We 
therefore get r(t, x) = Tait,x). 
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B.3 Proof of Lemma 4.2 

(i) Given a > 0, it is obvious from definition that r/(0, a) G (0, a) and r/(a, a) = a. Fix x G (0, a), 
and let denote the density of := Ta{t, x) — t. We obtain 

1 roo roo 

= I I e-('+l>‘^‘at)ds dt 

/ poo \ poo 

Notice that is the first hitting time to a by an one-dimensional Bessel process. We thus 
compute its Laplace transform from the formula in Brenner and Scott (2002): 




t.X 


(B.8) 


1 


1 + /3T- 


f 

f 


(B.9) 


E 


't,X 


\2 

_ A_ rpx 

e 2 -‘o 


(xX) 

2 


= cosh(xA) sech(aA), for x < a. 


Here, denotes the modified Bessel function of the first kind. Thanks to the above formula 
with A = yJ2f5s, we obtain from (B.8) that 

poo 

(B.IO) r}{x,a) = a / cosh(xy^2/3s) sech(a-\/2/Ss)ds. 

Jo 

It is then obvious that x i—>■ r/(x, a) is strictly increasing. Moreover, 


poo 

r]xx{x, a) = 2aj5‘^ / e“®scosh(x-\/2/?s) sech(aA/2/3s)ds > 0 forxG[0,a], 

Jo 

which shows the strict convexity. 

(ii) This follows from (B.IO) and the dominated convergence theorem. 

(iii) The proof divides into two parts. We will first prove the desired result with x*{a) G 
(0,a), and then upgrade it to x*{a) G (0,a*) in the second step. Fix a > 0. In view of the 
properties in part (i), we observe that the two curves y = rj{x,a) and y = x intersect at some 
x*{a) G (0, a) if and only if rjxio-,a) > 1. Define k{a) := rix{ci,a). By (B.IO), 


k{a) = a / e ^ ■\/2j3s tanh(a-^2/3s)ds. 

Jo 

Thus, we see that A:(0) = 0 and k{a) is strictly increasing on (0,1), since for any a > 0, 


k'{a) = J e ^tanh(a\/^) -|- 




cosh^(a\/^) 


ds > 0. 


By numerical computation, we find 

poo 

k{l/y/p) = / e“^\/^tanh(\/^)ds « 1.07461 > 1. 

Jo 

It follows that there must exist a* G (0, l/y^) such that k{a*) = r]x{a*, a*) = 1. Monotonicity 
of k{a) then gives the desired result. 

Now, for any a> a*, we intend to upgrade the previous result to x*{a) G (0,a*). Fix x > 0. 
By the definition of t] and part (ii), on the domain a G [x, oo), the map a i-)- r/(x, a) must either 
first increases and then decreases to 0, or directly decreases down to 0. From (B.IO), we have 

poo 

r]a{x,x) = 1 — X a/2/3s tanh(xA/ 2(Js)ds = 1 — k{x), 

Jo 
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where k is defined in part (iii). Recalling that k{a*) = 1, we have r]a{a*,a*) = 0. Notice that 

2 _ 

rjaa{o*,a*) = - k(a*) — 2Pa* + a* / 4/3se“^ (a*W2(5s)ds 

a* Jo 

< - A + 2/3a* <0, 
a* 

where the second line follows from tanh(x) < 1 for x > 0 and a* € (0, Since r]a{a*,a*) = 

0 and T]aa{a*,a*) < 0, we conclude that on the domain a G [a*,oo), the map a r}{a*,a) 
decreases down to 0. Now, for any a > a*, since r]{a*,a) < rj{a*,a*) = a*, we must have 
x*{a) < a*. 


B.4 Proof of Lemma 4.3 

Fix 0 < X < a and t > 0. Set T* := Ta{t, x) — t and := r'(t, x) — t. Since Ta Ta+e by 

definition for all e > 0, (B.9) implies that for any A > 0, 


cosh(Ax) sech(A(a + e)) = 'Kt^x 

< Ef. 


\2 

_ A_ rpx 

g 2 -^a+e 


\2 

_ A_ rpx 

e 2 


< E 




_ rpx 

e ^ ^ 


= cosh(Ax) sech(Aa), Ve > 0. 


As e ^ oo, we obtain ]. This, together with T* < T^, implies 

Ta = Ta a-s., or Ta{t,x) = r'(f,x) a.s. 
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